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Abstract — This paper analyzes the asymptotic exponent of 
the weight spectrum for irregular doubly-generalized LDPC (D- 
GLDPC) codes. In the process, an efficient numerical technique 
for its evaluation is presented, involving the solution of a 4 x 4 
system of polynomial equations. The expression is consistent with 
previous results, including the case where the normalized weight 
or stopping set size tends to zero. The spectral shape is shown 
to admit a particularly simple form in the special case where all 
variable nodes are repetition codes of the same degree, a case 
which includes Tanner codes; for this case it is also shown how 
certain symmetry properties of the local weight distribution at 
the CNs induce a symmetry in the overall weight spectral shape 
function. Finally, using these new results, weight and stopping set 
size spectral shapes are evaluated for some example generalized 
and doubly-generalized LDPC code ensembles. 

Index Terms — Doubly-generalized LDPC codes, irregular code 
ensembles, spectral shape, stopping set size distribution, weight 
distribution. 



I. Introduction 

Recently, the design and analysis of coding schemes repre- 
senting generalizations of Gallager's low-density parity-check 
(LDPC) codes Ul has gained increasing attention. This interest 
is motivated above all by the search for coding schemes which 
offer a better compromise between waterfall and error floor 
performance than is currently offered by state-of-the-art LDPC 
codes. 

In the Tanner graph of an LDPC code, any degree-q variable 
node (VN) may be interpreted as a length-q repetition code, 
i.e., as a {q, 1) linear block code. Similarly, any degree-.s check 
node (CN) may be interpreted as a length-s single parity- 
check (SPC) code, i.e., as a {s,s — 1) linear block code. The 
first proposal of a class of linear block codes generalizing 
LDPC codes may be found in ||2l, where it was suggested 
to replace each CN of a regular LDPC code with a generic 
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linear block code, to enhance the overall minimum distance. 
The corresponding coding scheme is known as a regular 
generalized LDPC (GLDPC) code, or Tanner code, and a CN 
that is not a SPC code as a generalized CN. More recently, 
irregular GLDPC codes were considered (see for instance ||3])- 
For such codes, the VNs exhibit different degrees and the CN 
set is composed of a mixture of different linear block codes. 

A further generalization step is represented by doubly- 
generaHzed LDPC (D-GLDPC) codes PI. In a D-GLDPC 
code, not only the CNs but also the VNs may be represented by 
generic linear block codes. The VNs which are not repetition 
codes are called generalized VNs. The main motivation for 
introducing generalized VNs is to overcome some problems 
connected with the use of generalized CNs, such as an overall 
code rate loss which makes GLDPC codes interesting mainly 
for low code rate applications, and a loss in terms of decoding 
threshold (for a discussion on drawbacks of generalized CNs 
and on beneficial effects of generalized VNs we refer to ^ 
and IS), respectively). 

A useful tool for analysis and design of LDPC codes and 
their generalizations is represented by the asymptotic exponent 
of the weight distribution. As usual in the literature, this 
exponent will be referred to as the growth rate of the weight 
distribution or the weight spectral shape of the ensemble, 
the two expressions being used interchangeably throughout 
this paper. The growth rate of the weight distribution was 
introduced in U] to show that the minimum distance of a 
randomly generated regular LDPC code with a VN degree of 
at least three is a linear function of the codeword length with 
high probability. The same approach was taken in Q and ||8l 
to obtain related results on the minimum distance of subclasses 
of Tanner codes. 

The growth rate of the weight distribution has been sub- 
sequently investigated for unstructured ensembles of irregular 
LDPC codes. Works in this area are ll9l- llT2l . In particular, 
in IIT2I a technique for evaluation of the growth rate of any 
(eventually expurgated) irregular LDPC ensemble has been 
developed, based on Hayman's formula. A similar approach 
was adopted to derive the (binary) weight distributions of 
nonbinary LDPC codes in ifTsl . and more recently the nonbi- 
nary weight distributions for nonbinary regular LDPC codes 
were analyzed in fHl . Asymptotic weight enumerators of 
ensembles of irregular LDPC codes based on protographs and 
on multiple edge types have been derived in ifTSl and lfT6l . 
IHTI . respectively. The approach proposed in JTJ] has then 
been extended to protograph GLDPC codes and to protograph 
D-GLDPC codes in flSl and Ull, respectively. In contrast to 



the present work, the evaluation of the weight enumerators 
in lfT5]| - lfT9ll require numerical solution of a high-dimensional 
optimization problem. 

In this paper, an analytical expression for the growth rate 
of the weight distribution of a general unstructured irregular 
ensemble of D-GLDPC codes is developed. In contrast to the 
formula developed in ll20l . the proposed expression holds for 
any codeword weight. The present work also extends to the 
fully-irregular case an expression for the growth rate obtained 
in 1211 assuming a CN set composed of linear block codes 
all of the same type. In the process of this development, we 
obtain an efficient evaluation tool for computing the growth 
rate exactly. This tool always requires the solution of a 4 x 4 
polynomial system of equations, regardless of the number 
of VN types and CN types in the D-GLDPC ensemble. 
As shown through numerical examples, the proposed tool 
allows to obtain a precise plot of the growth rate with a low 
computational effort. The derived result may be regarded as 
a generalization to the D-GLDPC case of the corresponding 
result for LDPC codes which was derived in W2\ . 

As explained in Section HI] assuming transmission over 
the binary erasure channel (BEC) and iterative decoding, the 
developed formula is also valid for the asymptotic exponent 
of the stopping set size distribution upon replacing the local 
weight enumerating function (WEF) of each VN and CN type 
with an appropriate polynomial function. 

A compact formula for the spectral shape is derived for the 
special case of a GLDPC code ensemble with a regular VN 
set and a hybrid CN set. Symmetry properties of the weight 
spectral shape are also investigated for this case; in particular, 
it is proved that the weight spectral shape function of such 
a GLDPC ensemble is symmetric w.rt. normalized weight 
a = 1/2 if the local WEF of each CN is a symmetric polyno- 
mial. This result establishes a connection between symmetry 
properties at a "microscopic" level (i.e., at the nodes of the 
Tanner graph) and symmetry of the "macroscopic" growth rate 
function. 

The paper is organized as follows. Section Ull defines the D- 
GLDPC ensemble of interest, and introduces some definitions 
and notation pertaining to this ensemble. Section Hill presents 
the main result of the paper regarding the evaluation of the 
weight and stopping set size spectral shapes. Section |IV] 
derives the spectral shapes of a family of check-hybrid GLDPC 
code ensembles as a corollary to the main result, and also 
identifies a sufficient condition for symmetry of the weight 
spectral shape for such ensembles. Section |V]provides a proof 
of the main result of the paper, and Section |VT] provides 
additional proofs for other results in the paper Section IVIII 
provides some examples of spectral shapes of GLDPC and 
D-GLDPC codes, and Section IVIIII concludes the paper. 

II. Preliminaries and Notation 

A D-GLDPC code consists of a set of CNs and a set of 
VNs. Each of these nodes is associated with a linear 'local' 
code, and with each VN is also associated an encoder (i.e., 
generator matrix). Each node is equipped with a set of sockets 
corresponding to the bits of the local codeword. The VN 



110 110 
10 110 10 
1110 1 




/101010\ 
110 11 
110 10 1 

^010111/ 



Fig. 1. Illustration of an example D-GLDPC code, together with the D- 
GLDPC codeword [1 0101000 1] (shown in blue on the diagram). Two 
of the generalized CNs are [7, 4] Hamming codes, and the other is a length-3 
SPC code. The VN set consists of two [6,4] hnear codes and one length-5 
repetition code (generator matrices are shown). The reader may verify that 
the bits induced on the Tanner graph edges through local encoding at the VNs 
correspond to valid local codewords from the CN perspective. 



sockets and the CNs sockets are connected together by edges 
in a one-to-one fashion; the resulting graph is called the Tanner 
graph of the code. A codeword in such a D-GLDPC code is 
defined as an assignment of values to the local information bits 
of each VN such that the corresponding bit values induced 
on the Tanner graph edges (through local encoding at the 
VNs) cause each CN to recognize a valid local codeword. An 
illustration of a simple D-GLDPC code is given in Figure [T] 
together with its codeword [1 0101000 1]. We next define 
a sequence {A^„} of D-GLDPC code ensembles; many of the 
following definitions and notations also appear in [|20J . 

In the D-GLDPC code ensemble 7M„, the number of VNs 
is denoted by n. The different CN types are denoted by the 
set Ic = {1, 2, . . . , Tic}; the local code Ct of CN type t ^ Ic 
has dimension, length and minimum distance denoted by ht, 
St and rt, respectively. Similarly, the different VN types are 
denoted hy ly ~ {1,2, ... ,ny}; the local code C( of VN type 
t G ly has dimension, length and minimum distance denoted 
by kt, qt and pt respectively. We assume that the local codes 
associated with all VNs and CNs have minimum distance at 
least 2 (i.e., rt >2,pt> 2), and that the dual codes of all of 
these local codes have minimum distance greater than oneQ. 

For t e Ic, the fraction of edges connected to CNs of 
type t is denoted by pt. Similarly, for t G ly, the fraction 
of edges connected to VNs of type t is denoted by At. CN 
and VN type-distribution polynomials are then given by p{x) 
and X{x) respectively, where p{x) := J^tei Pt^^*~^ ™d 
^{^) '■— J2tei ^tx"^*'^- If E denotes the number of edges 
in the Tanner graph, the number of CNs of type t G Ic is 

'An equivalent condition is that the generator matrix of each code Ct has 
no column consisting entirely of zeros. 
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then given by Ept/st, and the number of VNs of type t E ly 
is then given by EXt/qt- Denoting as usual p{x)dx and 
X{x) dx by J p and / A respectively, the number of edges 
in the Tanner graph is given by E = n/ J X and the number 
of CNs is given hy m = E J p. Therefore, the fraction of CNs 
of type t E Ic and the fraction of VNs of type t G /„ are given 

Pt . c Xt 
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respectively. A code in the irregular D-GLDPC ensemble 
corresponds to a permutation of the E edges connecting 
VNs to CNs. The length of any D-GLDPC codeword in the 
ensemble is given by 

' EXt \ ^ _ _ri_ \ - Affct 
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Note that this is a linear function of n. Similarly, the total 
number of parity-check equations for any D-GLDPC code in 
the ensemble is given by M = Ste/ Eii^L-hil^ 

The ensemble A4n is defined according to a uniform 
probability distribution on all El permutations of the Tanner 
graph edges. The design rate of the D-GLDPC ensemble is 
given by 

Ete/. Pt{l-Rt) 



R=l- 



(3) 



where for t E Ic (resp. t G /„), Rt is the local code rate of a 
type-^ CN (resp. VN). Each code in the ensemble has a code 
rate larger than or equal to R. 

The WEF for CN type t E Ic is given by 



u—rt 

Here, for each < u < St, Au'' > denotes the number 
of weight-M codewords for CNs of type t. We denote by ut 
the largest u G {rt, rt + 1, . . . , st} such that Au"^ > 0. The 
input-output weight enumerating function (lO-WEF) for VN 
type t E ly is given by 



kt qt 



x^y^ 
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Here Bu)u > denotes the number of weight-u codewords 
generated by input words of weight u, for VNs of type t. Also, 
-B^*' is the total number of weight-u codewords for VNs of 
type t. 

Although this paper is focused on the weight spectrum, all 
of the results developed in Sections lini4IV| can be extended to 
the stopping set size spectrum. A stopping set of a D-GLDPC 
code may be defined as any subset S of the code bits such 
that, assuming all code bits in S are erased and all code bits 
not in S are not erased, local erasure decoding at the CNs and 
VNs cannot recover any code bit in S, so no erasure can be 
recovered by iterative decoding]! A local stopping set for a 

-The concept of stopping set was first introduced in (221 in the context of 
LDPC codes. When applied to LDPC codes (i.e., all CNs are SPC codes), the 
definition of stopping set used in this paper coincides with that in 1221 . 



CN is a subset of the local code bits which, if erased, is not 
recoverable to any extent by the CN. A local stopping set for a 
VN is a subset of the local code bits together with a subset of 
the local information bits which, if both subsets are erased, are 
not recoverable to any extent by the VN. All results derived 
in this paper for the weight spectrum can be extended to the 
stopping set size spectrum by simply replacing the WEF for 
CN type t E Ic with its local stopping set enumerating function 
(SSEF), and replacing the lO-WEF for VN type t E ly with 
its local input-output stopping set enumerating function (lO- 
SSEF). 

We point out that for both VNs and CNs, the local SSEF de- 
pends on the decoding algorithm used to locally recover from 
erasures; for local maximum a posteriori (MAP) decoding, the 
reader is referred to [l20] Appendix B] for details. 

Finally, we introduce some mathematical notation. Let a{n) 
and b{n) be two real-valued sequences, where b{n) ^ 
for all n; we say that a{n) is exponentially equivalent to 
b{n) as n — )■ oo, writing a{7i) = if and only if 

lim„^oo JT-^^ log (a(n)/6(n)) = 0. Throughout this paper, 
the notation e — exp(l) denotes Napier's number, all the 
logarithms are assumed to have base e and for < x < 1 
the notation h{x) — —x\og{x) — (1 — a;)log(l — x) denotes 
the binary entropy function expressed in nats. 

III. Weight Spectral Shape of Irregular D-GLDPC 
Code Ensembles 

The weight spectral shape of the irregular D-GLDPC en- 
semble sequence {A^„} is defined by 
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where denotes the expectation operator over the ensem- 
ble Ain, and Aw denotes the number of codewords of weight 
w of a randomly chosen D-GLDPC code in the ensemble Ain- 
The limit in ^ assumes the inclusion of only those positive 
integers n for which an E Z and [Aan] is positive. Note 
that the argument of the growth rate function G{a) is equal 
to the ratio of D-GLDPC codeword length to the number of 
VNs; by this captures the behaviour of codewords linear 
in the block length. 

Using standard notation ifTTI . we define the critical exponent 
codeword weight ratio for Mn as a* := inf{a > | G{a) > 
0}. A D-GLDPC ensemble is said to have good growth 
behavior if a* > 0, and is said to have bad growth rate 
behavior if a* = 0. In ||20l , it was shown that a D-GLDPC 
ensemble always has good growth rate behavior if there exist 
no CNs or VNs with minimum distance 2 while, if there exist 
both CNs and VNs with minimum distance 2, the ensemble 
has good growth rate behavior if and only if C -V < 1, where 
the (positive) parameters C and V are given by 



C 



2 E 

t : rt=2 



ptA 

St 



V 



' E ■ 

t : pt=2 
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qt 
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Note that using (|2]i, we may also define the growth rate with 
respect to the D-GLDPC code's block length N as follows; 



H{uj) := lim 4logEA<„ [A^n] 



(6) 



3 



It is straightforward to show that 



H{u:) = 



(7) 



(8) 



where Kg is defined as the ratio of the D-GLDPC code's block 
length to the number of VNs, i.e.. 

Note that the parameter Kg is independent of N. 

The stopping set size spectral shapes of the ensemble 
sequence {A^„} for the case of bounded distance (BD) and 
MAP decoding at the CNs, whose definitions are analogous 
to (HI, will be denoted by G^i{a) and Gq,{a), respectively. 
Similarly the critical exponent stopping set size ratio will be 
denoted in these cases by a*^ and aj, respectively. 

In this section, we formulate an expression for the growth 
rate for an irregular D-GLDPC ensemble A^„ over a wider 
range of a than was considered in ll20l (where the case of 
small a was analyzed). 

The following theorem constitutes the main result of this 
paper. 

Theorem 3.1: The weight spectral shape of the irregular 
D-GLDPC ensemble sequence is given by 

where ccq, yo, and /3 are the unique positive real solutions 
to the 4x4 system of polynomial equation^ 



^0 



dA<*> 



2oj 



a 



and 



W / A) (1 + yozo) = Vqzo 



(10) 



(11) 
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This theorem is proved in Section |V] It is important to note 
that the solution always involves a system of 4 equations in 
4 unknowns, regardless of the number of different CN and 
VN types. Also, note that we can solve efficiently for the 
parameter a* without evaluating the entire spectral shape, by 
simply augmenting the system (fToli-lflJli with an additional 
equation which sets the right-hand side of ^ to zero. Note 
also that substituting for /3 from (fT3] l will further reduce the 
system to 3 equations in 3 unknowns. The reader may verify 

^Note that while UOt . jilt and I12t are not polynomial as set down here, 
each may be made polynomial by multiplying across by an appropiiate factor. 



that in the special case of LDPC codes, this result reduces to 
JTl Corollary 12]. 

We point out that Theorem 13.11 is consistent with Theo- 
rem 4.1 of II20I which provides an expression for G{a) valid 
for small a. This can be seen by conducting an analysis 
of ©-([ni) for the small -a case. This analysis, detailed in 
Appendix [B] yields the following slightly weaker version of 
Theorem 4. 1 of ll20l as a corollary of Theorem 13.11 

Corollary 3.2: The weight spectral shape of the irregular 
D-GLDPC ensemble sequence {Ain} is given by 



T 

G(a) = —a log a + 1 
V 



log- 



1 



^1 

-log 



UQi\i)) 



+ o(a), (14) 



where r denotes the smallest minimum distance over all CN 
types, -0 = 7'/(r— 1), and T denotes the minimum of 



> 0. 



over all types t £ ly and all pairs such that ^ 

The set is the set of all types t E ly such that this minimum 
T is achieved, and Pt denotes the corresponding set of pairs 
Finally, 



(i,i)ePt 



and 



(-) - E ^ E 



where 



C 
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(15) 



(16) 



(17) 



(this definition of the parameter G reduces to that given in Q 
in the case r = 2). 

When the term [T /%l])a\oga is nonzero, which happens 
when either r > 3 or p > 3 where p is the smallest minimum 
distance over all VN types, (fl4] i may be directly used to obtain 
an approximation to the parameter a* without solving the 
polynomial system in Theorem 13. II - this approximation is in 
general very good for ensembles characterized by sufficiently 
small a*. To obtain this, we set G{a*) — Q, a* ^ 0, and 
neglect the o{a) term in (fT4] l. yielding 



[Qi\i) 



(18) 



For an irregular GLDPC code ensemble, this approximation 
reduces to 

Q,* \-r/{pr-p-r)fj-p/{pr-p-r) ^g-^ 

where Ap is the fraction of edges connected to the degree-p 
VNs, i.e., to the VNs of lowest degree, and where G is defined 
in ( [TtI i. If the GLDPC code ensemble is variable-regular, (fT9] ) 
reduces to 

a* w C-P/(P'-P-'')e. (20) 
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An even simpler expression is obtained for regular LDPC 
code ensembles of VN degree p > 3 (as r = 2 for LDPC 
codes), for which (|20] | becomes 



(21) 



(4 - i)i/(i-2/rf„) 



where dy = pis the VN degree and dc is the CN degree. Some 
numerical results on this approximation will be presented in 
Section NM 



Theorem 3.3: For any D-GLDPC code ensemble, the 
maximum value of the weight spectral shape H{u!) defined 
in Q is given by i?log2, and is attained when a; = 1/2. 

Proof: First we note that the function H{lj) cannot exceed 
the growth rate of the total number of codewords in the code, 
i.e., H{u}) < limAT^oo log 2^^ = i?log2. An equivalent 
expression (obtained via (Q) is G{a) < KsRlog2. To com- 
plete the proof, we need only show that H{l/2) = i?log2, 
or equivalently, G{Ks/2) = KsR\og2. In the following we 
show that 



a 



El 
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= 2/0 = zo = 1 ; /? 



1 



2/A 



(22) 



makes (fT0l)-(fT3l) a consistent system of equations. First, it 
is easy to check that ( fTSl l holds under ( |22] |. Making the 
substitutions ( l22b in ( fTOl i yields 



E 

tela 



If 



-(1) 



.4(*)(1) 



(23) 



and 



dA 



(t) 



Up) 

Note that .4(*)(1) 

Hamming weight of the codeword c. Therefore, (l2Jt reduces 
to 



(1) 



l^u=0 ~ " dz 

wh(c), where ?i'H(c) denotes the 



7t 



tela 



9'»t 



(24) 



Note that the quantity in square brackets is equal to the 
average weight of a codeword in the local code Ct. Since 
we assume that the dual code of has minimum distance 
greater than one, it follows from the MacWilliams identities 
(see, e.g., 1271 Section 8.2]) that the average codeword weight 
is equal to St/2. Using this fact, (|24] | reduces to 



N Itst 1 

UP) 2^ ^ = 9 



tela 



which may be seen using the definition ^ of jt and the fact 
that J2tei P^ ^ ^' Similarly, making the substitutions 
(fni i yields 



2kt 



2/A 



Since we assume that all VNs have dual codes with minimum 
distance greater than one, this reduces to 



E 



5tqt 
2 



1 



2/A' 



which may be seen using the definition ([T]i of 5t and the fact 
that X^te/ , At = 1. Making the substitutions (l22l) in (fTTI) yields 



E^* 

tei^ 



u=0 l^v=0 "^",1' 



(*) 
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For t G ly, the quantity in square brackets is equal to the 
average weight of an information word for the local code C^; 
this is always equal to kt/2. Thus we obtain 

E Sjkt _ Ks^ 
~ ~ ~2~ ' 

tG/„ 

which follows from the definition ^ of St and the definition 
^ of Kg. Finally, making the substitutions ( l22b in ^ yields 



G(AV2) = ^<5aog2^' + fi^)^7tlog2"* 

teiv ' tela 



log 2 




= K,i?log2, 

where we have used the expression (|3]l for the (design) rate R 
of the D-GLDPC code. ■ 



Note that Theorem 13.31 only holds in general for the weight 
spectral shape, and not for the stopping set size spectral shape. 
It is interesting to note that this phenomenon, where the 
maximum weight spectral shape value of R log 2 occurs at half 
the block length, appears to be quite a general one, occurring 
widely across many ensembles: for example, all of the spectral 
shape plots for protograph-based LDPC codes contained in 
ifTsl have this property (these were obtained by non-analytical 
optimization methods). Also, Gallager's ensemble described 
in m Section 2.1], where the parity-check matrix contains 
statistically independent equiprobable binary entries, shares 
the same property (note that this is not a low-density code 
ensemble). 

IV. Spectral Shape of Check-Hybrid GLDPC Codes 

In this section we consider the special case of a D-GLDPC 
code ensemble where all VNs are repetition codes of the 
same length, i.e., a check-hybrid GLDPC code ensemble with 
regular VN set. The proofs of all lemmas in this section are 
deferred to Section |VT] 

A. Evaluation of the Spectral Shape 

In the following, we show that a compact expression for 
the spectral shape follows in this case as a natural corollary 
to Theorem 13.11 First we introduce the following definition. 



Definition 4.1: Let 

M - Up) E ^ 1 

tela 
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and define the function f 



as 



it- 



teia 



__dz__ 
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Note that we have M = 1 if and only if ut = St for all 

Lemma 4.1: The function f fulfills the following proper- 
ties: 

1) f(0) = f'(0) = 0; 

2) f is monotonically increasing for all z > 0; 

3) lim^^+oo f (z) = M. 



Note that, due to Lemma 14.11 the inverse of f , denoted by 
: [0, M) ^ IR+, is well-defined. We are now in a position 
to state the main result of this section. 

Theorem 4.2: Consider a GLDPC code ensemble with a 
regular VN set, composed of repetition codes all of length q, 
and a hybrid CN set, composed of a mixture of ric different 
linear block code types. Then, the weight spectral shape of the 
ensemble is given by 

G{a) = (l-g)/i(a)-galogf-i(a) 

Proof: The ensemble constitutes a special case of a D- 
GLDPC code ensemble where all VNs are repetition codes of 
length q >2, with corresponding lO-WEF 



B{x,y) = l + a;y« 



(28) 



Using Theorem 13.11 the spectral shape function simplifies to 
(noting that J A = 1/g in this case) 



G{a) = logB(xo,2/o) - alogxo 



tela ^ ^ 



(29) 



where the values of xq, Un^ /? in ( l29] l are found by solving 
the 4x4 polynomial system 
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(31) 
(32) 

(33) 



1 + ^02/0 q 

Note that we are certain of the existence of a unique real 
solution to the polynomial system such that > 0, ?/o > 0, 
Zo > 0, /3 > 0, due to Hayman's formula. We solve this 



system of equations sequentially for the variables /3, zq, Uq 
and a;o (respectively). First, combining (l3Tl i and (|32| yields 



P = qa . 



(34) 



Substituting ( l34l i into ( |30] | yields f(zo) = a which may be 
written as 

zo = ri(a). (35) 



Using ( l34b and ( |35] ) in ( |33] | yields 



(l-a)f-i(a) 
Finally, substituting (|34] i and (|36] l into (|32] i yields 

1-9 



Xo = 



1 — a 



(36) 



(37) 



Substituting OIJ, ^ and ([STll into and simplify- 
ing, leads to (|22l). ■ 

The expression (l27T l holds regardless of whether the en- 
semble has good or bad growth rate behavior Note that, 
according to (|27T i, the growth rate G{a) is well-defined only 
for a G [0,M]. This is as expected due to the following 
reasoning. A codeword of weight an naturally induces a 
distribution of bits on the Tanner graph edges, anq of which 
are equal to 1. Also note that the maximum number of ones 
in this distribution occurs when a maximum weight local 
codeword is activated for each of the 7fTO CNs of type 
t S /c, and is thus given by mj^tei ItUt- Hence, we have 
anq < mj^tei ItUt, i.e., a < M. 

By considering Theorem 14.21 in the special case of Tanner 
codes, we obtain the following corollary. 

Corollary 4.3: Consider a Tanner code ensemble where 
all variable component codes are length-q repetition codes and 
where all check component codes are length- s codes with 
weight enumerating function A{z) = 1 + J2u=r ^uz""- The 
weight spectral shape of this ensemble is given by 

G{a) = (1 - q)h{a) -qa \og{r\a)) + ^ log A(f-i(«)) 

' (38) 
where the function f is given by (special case of (|26] l) 



f(z) 



zA'jz) 
sA{z) 



(39) 



and f"^ : [0, M) ^- R+ is well-defined, where M = f and w 
denotes the largest u £ {r,r + 1, . . . , s} such that Au > 0. 

Note that, in the special case where all CNs are SPC codes, 
(|38] | becomes equal to the spectral shape expression for regular 
LDPC codes developed in ifTTl Theorem 2] for the case of 
stopping sets. Also note that, in some cases, (l38l l can be 
expressed analytically as f^^(a) admits an analytical form. 
As shown in Appendix |C] this is the case, for instance, of 
(3, 6) and (4, 8) regular LDPC code ensembles. This shows 
that some of Gallager's Bj k{X) functions (Q can be expressed 
in closed form. 



6 



B. Symmetry of the Weight Spectral Shape 

As in the previous subsection, consider a GLDPC code 
ensemble with a regular VN set and a hybrid CN set. Next, 
we show how a symmetry in the overall weight spectral shape 
of the ensemble is induced by local symmetry properties in 
the WEFs of the CNs. 

Definition 4.2: The WEF of CN type i e is said 
to be symmetric if and only if ~ aI*' for all u e 

{0,1,..., St}. 

Lemma 4.4: The WEF of CN type t e /c is symmetric 
if and only if the all-1 codeword belongs to the code. 

Lemma 14.41 proves that the WEF of a linear block code is 
symmetric if and only if ut = St- 

Lemma 4.5: The WEF of CN type t e 1^ fulfills 

= (z-i) (40) 

for all z <S if and only if it is symmetric (equivalently, if 
and only if Ut — St). 

Lemma 4.6: If A^*)(z) is symmetric for every t £ Ic (i.e., 
if M = 1), then the inverse function fulfills 

f-(M-.) = ^ (41) 

V a e (0, A/). 

Theorem 4.7: Consider a GLDPC code ensemble with a 
regular VN set, composed of repetition codes all of length q, 
and a hybrid CN set, composed of a mixture of ric different 
linear block code types. If is symmetric for each t G 

Ic (equivalently, if M = 1), then the spectral shape of the 
ensemble fulfills 



G{M - a) = G{a) 



(42) 



for all a e (0,Af). 

Proof: Assume that (z) is symmetric for each t £ Ic 
(i.e., M ~ 1). From (IZTT i we have: 

G(M - a) = (1 - q)h{M - a)- q{M - a)logr\M~a) 
+ q il p)Y.^t log A^''^ (f-i(M-a)) 



(a) 



(b) 



(c) 



(1 - q)h{M - a) - q{M - a) log ■ 



tele ^ ' 

(1 - q)h{M -a)-qa \og{r\a)) 

+ qiIp)J2^tlogA^'\f-\a)) 



tela 



G{a) 



where (a) follows from Lemma 14761 (b) from Lemma |43] and 
(l25T l. and (c) from M = 1. ■ 

We remark that the converse of this result, i.e., that if 
G{a) = G(M - a) for all a € (0, M), then is 
symmetric for every t £ 1^ (and therefore M = 1), appears 
to hold for almost all code ensembles; however this converse 
appears to be difficult to prove in the general case. 



V. Proof of Theorem 13. II 

In this section we prove Theorem 13.11 The proof uses the 
concepts of assignment and split assignment, defined next. 
These concepts were introduced in lfT2l and ll20l . respectively. 

Definition 5.1: An assignment is a subset of the edges 
of the Tanner graph. An assignment is said to have weight k 
if it has k elements. An assignment is said to be check-valid 
if the following condition holds: supposing that each edge of 
the assignment carries a 1 and each of the other edges carries 
a 0, each CN recognizes a valid local codeword. 

Definition 5.2: A split assignment is an assignment, to- 
gether with a subset of the D-GLDPC code bits (called a 
codeword assignment). A split assignment is said to have split 
weight {u, v) if its assignment has weight v and its codeword 
assignment has u elements. A split assignment is said to be 
check-valid if its assignment is check-valid. A split assignment 
is said to be variable-valid if the following condition holds: 
supposing that each edge of its assignment carries a 1 and 
each of the other edges carries a 0, and supposing that each 
D-GLDPC code bit in the codeword assigment is set to 1 and 
each of the other code bits is set to 0, each VN recognizes a 
local input word and the corresponding valid local codeword. 

For ease of presentation, the proof is broken into two parts. 

A. Number of Check-Valid Assignments of Weight Sm 

First we derive an expression, valid asymptotically, for the 
number of check-valid assignments of weight Sm. For each 
t e Ic, let Etm denote the portion of the total weight Sm 
apportioned to CNs of type t. Then > for each t G Ic, 
and X^te/, <^t = ^- ^Iso denote e = (ei £2 • • ■ CnJ- 

Consider the set of 7fm CNs of a particular type t E Ic, 
where 7t is given by ([T]). Using generating functions, the 
number of check- valid assignments (over these CNs) of weight 
etm is given by 



N, 



(etm) = Coeff 



7tm 



where Coeff [p{x),x'^] denotes the coefficient of x'^ in the 
polynomial p{x). We next apply Lemma lA.ll substituting 

A{x) = A(*'(a;), i = 7tm and ^ — et/^t\ we obtain that 

as TO — )■ cx) 



N. 



htm] 



(etm) = Coeff 



cxp 



|m (^7tlogA(*)(zo^t) - etlog 2o,t) } 



(43) 
(44) 



where, for each t £ Ic, zo^t is the unique positive real solution 
to 



7t 



dz 



ZO.t) 



(45) 



A('){zo.t) 

The number of check-valid assignments of weight Sm 
satisfying the constraint e is obtained by multiplying the 
numbers of check-valid assignments of weight etm over 7^771 
CNs of type t, for each t £ Ic, 

7Vi^)(<5TO)=n^e"""^ 

tela 



\etm) . 



(46) 
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The number Nc{5m) of check- valid assignments of weight 
5m is then equal to the sum over all admissible 

(47) 



vectors e; therefore by (I44t . as m — >■ oo 

iVc(<5m) = 



exp{mT/F(e)} 



where 



W{e) = {it log^(*)(zo,t) - et log 



20. t 



(48) 



As m — >^ oo, the asymptotic expression is dominated by the 
distribution e which maximizes the argument of the exponen- 
tial functiorQ. Therefore as m oo 



N(.{5m) = exp {mX} 



where 



X = maxVF(e) 

e 

and the maximization is subject to the constraint 

tele 



(49) 



(50) 



(51) 



together with e* > for each t e /c, and for every t e /c, 
zo.t is the unique positive real solution to (l45T l. Note that for 
each t g /c, (|45] | provides an implicit definition of zo.t as a 
function of ej. 

We solve this optimization problem using Lagrange multi- 
pliers; at the maximum, we must have 



dW{e) _ dV{e) 



(52) 



det det 

for all t E Ic, where A is the Lagrange multiplier This yields 



det 



If 



zo,t 



log zoj = A 



(53) 



The term in square brackets is equal to zero due to (145) : 
therefore this simplifies to log zg.t = —A for all t E Ic- We 
conclude that all of the {zo,t} are equal, and we may write 

zo^t =zo ytelc- (54) 
Making this substitution in ( |49] l and using ( fSTT i we obtain 

Nci6m) - cxp |m 7* \ogA^'\zo) - Slogzo^ | . 

(55) 

Summing (l45l l over t E Ic and using ( fsTl i and (|54] | implies 
that the value of zq in (l55l l is the unique positive real solution 
to ([Tol l (here we have also used the fact that n J p ~ ni J X). 

'^Observe that as m — > 00, J^jCxp(r)iZt) = cxp{m maxtjZf }) 



B. Polynomial-System Solution for the Growth Rate 

Consider the set of 5tn VNs of a particular type t £ I,,, 
where 5t is given by ([T]i. Using generating functions, the 
number of variable-valid split assignments (over these VNs) 
of split weight [atn, f3tn) is given by 

Nl'r {atn, Ptn) - Coeff [B^'^ {x, y)j , z"'"/*' 

where Coeff [p{x, y),x'^y'^] denotes the coefficient of x'^y'^ in 
the bivariate polynomial p{x, y). Next we apply Lemma lA.21 
substituting B{x,y) = i = 5tn, ^ = at/5t and 

9 = Pt/St; we obtain that as n — > 00 



ivf;"^ (atn, = Coeff 



where 



a;"'"/'" 



exp 



{nXf''(at,/3t)} (56) 



(at , /3t ) = (5t log (a;o,t , 2/o.t ) - at log xo.t - /3t log yo,t 

(57) 

and where Xo^t and yo,t are the unique positive real solutions 
to the pair of simultaneous equations 



dx 



ixo.t,yo,t) 



B(t){xo.uyo,t) 



■ xo,t = at 



and 



Ot r ■ 2/0, t — Pt 



(58) 



(59) 



Next, note that the expected number of D-GLDPC code- 
words of weight an in the ensemble A4n is equal to the 
sum over /3 of the expected numbers of split assignments of 
split weight (an, f3n) which are both check-valid and variable- 
valid, denoted <;',3„: 

H 

This may then be expressed as 



[Aan] = ^ ^ ^'c^valid(/3?^) 

\{N[';,''\atn,Ptn) (60) 



Qt>o,te/„ ft>o,te/„ 



where 



(61) 



Here Pc-vaiid(/3'T^) denotes the probability that a randomly 
chosen assignment of weight fin is check-valid, and is given 
by 

P.-..m{Pn) = NciPn) / (y^^ 

Applying lEl eqn. (25)], we find that as 77. — > cx) 

E 



Pn 
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Combining this result with (l55l l. we obtain that as n ^ oo 

-valid 

{(in) = exp{nY{P)} 

where 

- ( J^) E 7. log (zo)) - /? log zo - 
Therefore, as n — > oo 

^ ^ cxpjn(^xf')(a„A) + m)| • 



at>0 

at=a 



(62) 



Note that the sum in (162b is dominated asymptotically by the 
term which maximizes the argument of the exponential func- 
tion. Thus, denoting the two vectors of independent variables 
by a = (Q!t)tG/„ and (3 = {Pt)^!^, we have 



G{a) — maxS'(a,/3) 

a,/3 



(63) 



where 

S{a,l3) = x\''\o^t,Pt)+Y{P) (64) 

tG/„ 

where /3 is given by (l6Tl i. and the maximization is subject to 
the constraint 

R{a., (3) ^ Y at = a (65) 

tG/„ 

together with at > and appropriate inequality constraints on 
fit for each t E 1^. 

Note that (fTOl i provides an implicit definition of zq as a 
function of /3. Similarly, for any t E ly, (ISST i and (|59] l provide 
implicit definitions of xo^t and yo.t as functions of the two 
variables at and 

We solve the constrained optimization problem using La- 
grange multipliers; at the maximum, we must have 

dS{a,l3) _ dR{a,(3) 
dat ' dat 
for all t E ly, where /i is the Lagrange multiplier. This yields 



dxp^t 
dat 



at 



-Q^\^vi,t^ yo,t) 



log Xo,i 



dat 



dB 



o^ixo,t,yo,t) (3t 



3^*^X0,1, yo,t) yo,, 



The terms in square brackets are zero due to (ISFi and (l59l 
respectively; therefore this simplifies to log xo,t — — /i for all 
t G ly We conclude that all of the {xq.*} are equal, and we 
may write 

XO,t = yt e ly . (66) 

At the maximum, we must also have 

dS{a,l3) _ dRia,j3) 



for all t e ly. This yields 



dat 

dyo,t 
dl3t 



-Q^ixo,t,yo,t) 
BW{xo,t,yo,t) 



at 
Xo,t 



dB 



a^ixo^t,yo.t) (3t 



dzo 



B^*^xo,t,yo,t) yo,t 
Ip 



log?/0,t - log 20 

1-/3/A 



loa 



/A 



sG/c 



The terms in square brackets are zero due to 
([Tol l respectively; therefore this simplifies to 



Zoya^t 



/3/A 



1 Vte ly . 



/3/A 
= 0. (67) 
and 

(68) 



We conclude that all of the {yo.t} are equal, and we may write 

yo,t^yo ytelc. (69) 

Rearranging (l68T l we obtain (fTSl l. Also, summing (ISST i over 
t e /„ and using ( |65] l and ( |66] l yields ( fTTT i. Similarly, summing 
(|59] l over t e /„ and using (|6T]i and (|69l) yields ( fT2b . 
Substituting back into ( |64l i and using ( |66] l, ( |69] l, ( |65] l and ( |6T] ) 
yields 

'^(") = E ^* (^0' ^ " a-'o - /3 log yo 

^^^^7.1ogA(^n^o)-/31ogzo-^^^^ (70) 



/A 



seio 



/A 



where ccq, j/Oj zq and /3 are the unique positive real solutions 
to the 4 X 4 system of equations ([TO]l, (dB, ([T2]i and ( fTlT l. 
Finally, ( fTSl ) leads to the observation that 



log 2:0 - /3 log yo 



h{/3jX) _ log(l-/?/A) 



/A /A 
which, when substituted in dTOl i. leads to (|9l). 

VI. Proofs of Lemmas in SectionHV] 

Proof of Lemma \4.1\ We prove the first property, as the 
proofs of the second and the third properties are straightfor- 
ward. The derivative of f (normalized w.rt. j p) is given by 

, , r , < (tw % ,2 X (ti ^ ^ 1 r , < (tw N 1 2 



dz + ^ dz2 



dA'''(g) 
dz 



[AW{z)Y 



The denominator of the fraction in each term in the sum is 
strictly positive for all z > 0. The numerator of the fraction 
in term t E Ic in the sum may be expanded as 

(1 + Aw^nif: uaw,^-^ +f:u{u- i)4*^z"-i) 

v—rt u—vt u—rt 

U—rt v—vt 



dPt 



dpt 



U—rt U—rt 
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Observe that in this expression, each term in the second sum- 
mation with u = V is zero, while each (u, v) term in the second 
summation (with u > v) added to the corresponding {v,u) 
term is positive for z > 0, since u(u — v)Au^A^''z"^^^^ + 
v{v - = {u - > and 

therefore the second summation is nonnegative for z > 0. 
Since the first summation is strictly positive for z > 0, it 
follows that f'(z) > for all z > 0. ■ 



Proof of Lemma \4.4l The sufficient condition (if a linear 
block code has the all-1 codeword then its WEF is symmetric) 
is a well-known result in classical coding theory. Next, we 
provide a proof for the necessary condition. 

Reasoning by contradiction, assume that CN type t e Ic has 
a symmetric WEF A(*)(z) and a maximum codeword weight 
ut < Sf. Note that, under these hypotheses, we necessarily 
have A^^ = 1. Without loss of generality, we assume that 
the (unique) codeword of weight Uf has all its 1 entries in 
the Ut leftmost positions. We build a generator matrix for 
the component code associated with the CN in the form 
G^*^ = [G^i\G2^], where cf^ is an ht x ut matrix whose 
first row is the all-1 vector, and is an ht x (st — ut) 
matrix whose first row is the all-0 vector Note that, due to 
the above-stated hypotheses, G^*' has a unique all-1 row. We 
denote by A'--*'^'>{z) the WEF associated with the matrix G^'. 
Since g'*'' has a unique all-1 row, A^''^^ (z) is symmetric, i.e., 
^i*''' = 4* -I for all w e {0, . . . , Ut}. 

It is now convenient to represent the WEF of the original 
code as a "balls and bins" system. More specifically, there 
are st + I bins, each uniquely associated with a weight u, 
and 2''' balls, each uniquely associated with an information 
word V (and then with the codeword vG^*^). Bins are labeled 
0, 1, . . . , St, such that each label is equal to the corresponding 
codeword weight. They are arranged with increasing labels 
from left to right. The number of codewords in bin u E 
{0, 1, . . . , St} is the number of codewords of weight u. 

We consider filling the bins according to the following 
procedure. At the beginning, all bins are empty. Then, in the 
initial phase the 2''* balls are placed into the bins according to 
the WEF A^*'^^z) corresponding to Gi\ Note that no balls 
are placed in bins with label in {ut + 1, . . . , st} and that, due 
to the symmetry of A^*'^^(z), the number of balls in bins u 
and Ut — u is the same for all u S {0, . . . , ut}- Then, in the 
adjustment phase the balls are moved in order to match the 
WEF AW(z), according to Gj*^ . The key observation here is 
that, in the adjustment phase, every ball must either stay in 
its current bin, or else move to the right. This is because, for 
any information word v, of length ht, the Hamming weight of 
vGi '' cannot be larger than the Hamming weight of vG^*\ 

Denoting by Wmin the minimum weight such that Au'^"^ ^ 
Au\ we must have Au^^H > Al*2i„ (since no ball can move 
into bin Umin, while at least one ball has moved out). Note 
that the number of balls in all bins corresponding to weights 
smaller than Umin remains unchanged. Since A^*'^)(z) is 
symmetric, and since so is A*^*^ (z) by hypothesis, we must also 
have ^tijiu^in > ^ot^- iimin- follows that the total number of 
balls in bins with labels in {wt — Wmin, ■ ■ ■ ,ut} has decreased 



during the adjustment phase. But this is a contradiction, and 
so the result is established. ■ 

Proof of Lemma 14.51 Assume A'*)(z) is symmetric (and 
therefore Ut = st). We have 



M=0 

St 



u=0 

= A«(z) 

where the final equality is due to A[*^_^ = for all v G 
{0, 1, . . . , St}- Conversely, assume that (|40] | is satisfied for all 
z e It can be easily recast as 

St flt 



u=0 



u=0 



In order for this equality to be satisfied for all z e 



we 



must have A:-, 



itv 

A\!^ for all u e {0, 1, . . . , s*}. Hence, 
A(*)(z) must be symmetric. ■ 

Proof of Lemma \4.6\ We prove that the function f fulfills 

f(z) = M - f (z-i) (71) 

V z e M+ if A^*^ (z) is symmetric for every t e Ic- The result 
is then obtained by applying the inverse function f^^ to both 
sides of dlB and by letting f(z-i) = a for all z e M+\{0}. 

Assuming that the WEF of CN type i e /c is symmetric, 
we have, differentiating ( l40l i. 



dA(*)(z) _ ,^,,dA(*)(z-i) 



dz 



dz- 



^+i2tz"'-iA(*)(z-i). 



Multiplying by z and using (gOl) yields 



dyl(*)(2 



-,iit— 1 



— \ +utA^*\z) 



(72) 



Then, 



-f(z-i) = M-(ip)^ 



It 



tela 



yl(*)(z-i) 



(a) 



Up) E 



Up) E "* 

teic \ 



[ dA<''(z-^) 



Am{z) 



it- 



Ut 



A(*)(z) + z 



dA<*'(2) 
dz 



Ut 



^(*)(z) 



A(*)(z) 



f(z) 



where we have used (l25T l and (|40] | in (a), and (|72] | in (b). ■ 

VII. Examples 

In this section, the spectral shapes of some example GLDPC 
and D-GLDPC ensembles are evaluated using the polynomial 
solution of Theorem [TT] We will consider both BD and MAP 
CN decoding. In the former case, the local SSEF (BD-SSEF) 
is given by 

*(*)(z) = l+£ (^'j)zV (73) 
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TABLE I 

Coefficients of X{x) and p{x) for the two example D-GLDPC 

ENSEMBLES. 



Ensemble 1 


Variable nodes 




Check nodes 






l:repetition— 2 


Ai 


= 0.055646 l:Hamming{7,4) 


Pi 


= 0.965221 


2:SPC-7 (C) 


A2 


= 0.944354 2:SPC-7 


P2 


= 0.034779 


Ensemble 2 


Variable nodes 




Check nodes 






l:repetition— 2 


Ai 


= 0.022647 l:Hamming(7,4) 


Pi 


= 0.965221 


2:SPC-7 (C) 


A2 


= 0.100000 2:SPC-7 


P2 


= 0.034779 


3:SPC-7 (A) 


A2 


= 0.539920 






4:SPC-7 (S) 


A2 


= 0.337432 
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Ensemble l (2 VN types) 

Ensemble 2 (4 VN types) 



0.001 0.002 0.003 0.004 0.005 0.006 0.007 0.008 0.009 0.01 
CI 



Fig. 2. Growth rates of the two example en.sembles described in Example l7.1l 
Ensemble 1 has bad growth rate behavior, while Ensemble 2 has good growth 
rate behavior with a critical exponent codeword weight ratio of a* = 2.625 X 
10-3. 



In the latter case, the local SSEF (MAP-SSEF) is given by 



(74) 



where ^i*^ > is the number of local stopping sets (under 
MAP decoding) of size it|f| Furthermore, numerical examples 
are presented on the approximation of the parameter a* for 
regular LDPC code ensembles, based on (l2ll . 

Example 7.1: [D-GLDPC ensembles with Hamming 
CNs and SPC VNs] In this first example, we design two 
ensembles with design rate i? = 1/2 using Hamming (7,4) 
codes as generalized CNs and SPC codes as generalized VNs. 
Three representations of SPC VNs are considered, namely, 

^Denoting by Gf any generator matrix for a type-t CN, a local erasure 
pattern is a local stopping set under MAP decoding when each column of Gf 
corresponding to erased bits is linearly independent of the columns of Gt 
con'esponding to the non-erased bits. 



Fig. 3. Spectral shapes of the Tanner code ensemble in Example 17.21 
Solid: weight spectral shape (critical exponent codeword weight ratio: a* = 
0.18650). Dashed: stopping set size spectral shape under MAP decoding at the 
CNs (relative minimum stopping set size: a J = 0.11414). Dotted: stopping 
set size spectral shape under BD decoding at the CNs (critical exponent 
stopping set size ratio: olL = 0.01025). 



the cyclic (C), the systematic (S) and the antisystematic (A) 
representations 0. 

Ensemble 1 is characterized by two CN types and two 
VN types. Specifically, we have 1^ = {1,2}, where 1 G /c 
denotes a (7, 4) Hamming CN type and 2 e /c denotes a 
length-7 single parity check (SPC) CN type, and = {1, 2}, 
where 1 e denotes a repetition-2 VN type and 2 e /„ 
denotes a length-7 SPC CN type in cyclic form. Ensemble 
2 is characterized by two CN types and four VN types. 
Specifically, we have 1^ = {1,2}, where 1 E Ic denotes 
a (7,4) Hamming CN type and 2 e Ic denotes a SPC-7 
CN type, and 1^ = {1,2,3,4}, where 1 G denotes a 
repetition-2 VN type, 2 € /„ denotes a length-7 SPC CN 
type in cyclic form, 3 S /t, denotes a length-7 SPC CN 
type in antisystematic form, and 4 G ly denotes a length-7 
SPC CN type in systematic form. The edge-perspective type 
distributions of the two ensembles are summarized in Table H] 

Both Ensemble 1 and Ensemble 2 have been obtained by 
performing a decoding threshold optimization with differential 
evolution (DE) 1231 . Ensemble 1 has been obtained by only 
imposing the node type and i? = 1/2 constraint. In this case 
we have C • y = 1.19 > 1, so the ensemble has bad growth 
rate behavior (a* = 0). Ensemble 2 has been obtained by 
imposing the node type and R = 1/2 constraint, together 
with the constraints C ■ V < 0.5 and A2 > 0.1. Since in 
this case we have C ■ V ^ 0.5 < I, the ensemble has good 
growth rate behavior (a* > 0). The expected good or bad 
growth rate behavior of the two ensembles is reflected in 
the growth rate curves shown in Fig. |2] Using a standard 
numerical solver, it took only 5.1 s and 6.7 s to evaluate 100 
points on the Ensemble 1 curve and on the Ensemble 2 curve, 
respectively. The relative minimum distance of Ensemble 2 is 
a* = 2.625 X 10"^ 

''The (fc X (fc + 1)) generator matrix of a SPC code in A form is obtained 
from the generator matrix in S form by complementing each bit in the first 
k columns. Note that a (fc X (A; + 1)) generator matrix in A foiTn represents 
a SPC code if and only if the code length q = fc -|- 1 is odd. For even fc + 1 
we obtain a dm in = 1 code with one codeword of weight 1. 
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Fig. 6. Actual values of a*, and the corresponding approximated values 
based on )2U . for some regular LDPC code ensembles. 




0.2 0.4 0.6 0.8 1 

a 



Fig. 5. Weight spectral shape of the Tanner code ensemble in Example 17.41 



Example 7.2: [Tanner code with (7, 4) Hamming CNs] 
Consider a rate R = 1/7 Tanner code ensemble where all VNs 
have degree 2 and where all CNs are (7, 4) Hamming codes 
(it was shown in Q, H) that this ensemble has good growth 
rate behavior). The WEF of a Hamming (7, 4) CN is given by 
A{z) = l + 7z^ + Zz"* + z'^, while its local MAP-SSEF and 
BD-SSEF are given by $(z) = 1 +7 z^ + 10 z'^ +21 z^ +7 z^+z'^ 
and ^'(z) = 1 + 35z^ + 35z^ + 21z^ + 7z^ + z'^ respectively. 
Note that we have M = ^ = 1 in all three cases. A plot 
of G{a), G$(a) and G'*(a) obtained by implementation of 
(l38T l is depicted in Fig. [3] We observe that A{z) satisfies the 
conditions of Theorem 14.71 This is reflected by the fact that 
the weight spectral shape G{a) is symmetric with respect to 
a = 1/2. 

Example 7.3: [Check-hybrid ensemble] Consider a rate 
i? = 1/3 check-hybrid GLDPC code ensemble where all VNs 
are repetition codes of length q — 3 and whose CN set is 
composed of a mixture of two linear block code types (/c = 
{1, 2}). CNs of type 1 € are length-7 SPC codes with WEF 
A(i)(z) = [(1 + zY + (1 - zy]/2 and 71 = 0.722, while 
CNs of type 2 e Ic are (7,4) codes with WEF A^'^\z) = 
1 + 5z^ + 7z'' + 3z^ and 72 = 0.278. The weight spectral 
shape of this ensemble, obtained from (|27] i, is depicted in 
Fig.|4] Note that for this ensemble M = 6/7, and also that the 
weight spectral shape does not exhibit any symmetry property 



(the CN WEFs are not symmetric). 

Example 7.4: [Ensemble with bad growth rate behavior] 
Consider a rate i? = 1/5 Tanner code ensemble where all VNs 
are repetition codes of length q ~ 2 and and where all CNs are 
(5,3) linear block codes with WEF A(z) = l + 3z'^ + 3z^ + z^. 
This ensemble is known to have bad growth rate behavior 
(a* = 0) since we have A'(0)C = 6/5 > 1, where A(a;) = x 
and C = 2A2/S l24l, ||25|. A plot of the weight spectrum for 
this ensemble, obtained from ( l38T l is depicted in Fig. |5] We 
observe that the plot of G{a) is symmetric, due to the fact 
that A{z) is symmetric (M = 1). As expected, the derivative 
of G{a) at a = is positive and hence a* — 0. 

Finally, note that for the ensembles of Figures |3]-|5] the 
weight spectral shape has in each case a maximum value 
of i?log2 which occurs at a = 1/2, in accordance with 
Theorem 13.31 

Example 7.5: Fig.|6]illustrates a comparison between the 
actual value of the parameter a* for some high-rate regular 
LDPC code ensembles (solid curves) and the corresponding 
approximation (ISTT i obtained via growth rate analysis in the 
small-a case (dashed curves). Each curve corresponds to a 
value of the design rate R, so the CN degree dc for each 
point is given by dc = dy/{l — R) where the VN degree 
dy is reported in abscissa. From the figure we see that the 
approximation is quite good for small values of d^, which are 
usually the ones of interest in practical applications. Moreover, 
the higher the design rate R the larger the range of dy over 
which the approximation is satisfactory. The actual values of 
a* and their corresponding approximated values are reported 
in Table for several regular LDPC code ensembles with 
dy = 3. A very good match can be observed. Similar examples 
may be developed, for instance, for Tanner codes through (|20T i. 

VIII. Conclusion 

A general expression for the weight and stopping set size 
spectral shapes of irregular D-GLDPC ensembles has been 
presented. Evaluation of the expression requires solution of a 
4x4 polynomial system, irrespective of the number of VN 
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TABLE II 

Comparison between the actual values of the parameter o* 

FOR SOME regular LDPC ENSEMBLES WITH VN DEGREE dy = 3 AND 
THE CORRESPONDING APPROXIMATED VALUES BASED ON f2l\ . 



R, dc 


a* , exact 


a* , approx. 


1/4, 4 


0.112159 


0.100677 


2/5, 5 


0.045365 


0.042473 


1/2, 6 


0.022733 


0.021746 


4/7, 7 


0.012993 


0.012585 


5/8, 8 


0.008117 


0.007925 


2/3, 9 


0.005410 


0.005309 


7/10. 10 


0.003785 


0.003729 



and CN types in the ensemble. A compact expression was 
developed for the special case of check-hybrid GLDPC codes, 
and both a necessary and a sufficient condition for symmetry 
of the weight spectral shape was developed. Simulation results 
were presented for two example optimized irregular D-GLDPC 
code ensembles as well as a number of check-hybrid GLDPC 
code ensembles. 



Appendix A 
Some Useful Lemmas 

The following results are special cases of lfT2l Corollary 
16]. 

Lemma A. 1: Let A{x) = 1 + X]m=c^"*^"' where 1 < 
c < d, be a polynomial satisfying > and Au > for all 
c < u < d. Then, as £ — >■ oo. 



Coeff 



iAix))\x' 



■it 



exp 



where z is the unique positive real solution to 

A'iz) 



A{z) 



(75) 



(76) 



Lemma A.2: Let 



k d 



u—1 v—c 



where k > I and 1 < c < d, be a bivariate polynomial 
satisfying Bu.v > for all 1 < w < fc, c < t; < rf. Then, as 

£ oo. 



Coeff 



(i?(x,2/))%x«V 



exp 



'log 



B{xo,yo) 



ill) 

where aio and yo are the unique positive real solutions to the 
pair of simultaneous equations 



and 



B{xo,yo) 
B{xo,yo) 



yo = o 



(78) 



(79) 



Appendix B 

Solution for Small Linear-Weight Codewords 



In this appendix, we analyze Theorem 13.11 for the case 
of small a. Specifically, we prove Corollary 13.21 which is a 
slightly weaker form of ll20l Theorem 4.1]. The proof consists 
of first obtaining expressions for zq, j/q and xq in terms of (3, 
and for /3 in terms of a, and then exploiting these in (|9]). 

First we develop an expression for zq in terms of (3. 
Considering (fTTT i. we have that its left-hand side must be 
o(l) because so is its right-hand side. The only possibility 
is that Xgyl = o(l) for some admissible choices of {i,j,t), 
and x'oyl = o{a) for all other admissible choices. Since the 
only difference between the left-hand side of ( fTTT i and the left- 
hand side of (fTSl i is represented by the coefficients of the ^gj/g 
terms, it follows that 



lim 13^0. 



(80) 



For the moment, the notation o(l) will be intended as /3 — > 0. 
(We will show later that f3 is proportional to a to the first 
order, so that the notation o{/3) is equivalent to the notation 
o{a).) Because of the above discussion, the left-hand side of 
dTol ) must also be o(l), a condition which can be satified if and 
only if Zg = o(l) for some admissible choices of {u, t) and 
Zq = o{(3) for all other admissible choices of (u,t). Consider 
now ( [Tol l written as an equality of polynomials. Due to dSOl l, 
its left-hand side is dominated by the terms corresponding to 
u = r, and the equation can be written in the form 



4 E 

t : rt=r 



St 



/3/A(l + o(l)) 



c 



1/r 



(1+0(1)). 



(81) 



We next develop an expression for yo in terms of /3; from 
(fT3b we have 



yo 



1-/5 /A 

which, combined with (ISTI ) and dHOl l respectively, yields 

yo = C'/''{l3!Xf^'{l + o{l)). (82) 

Next, we develop an expression for xq in terms of /3. To 
this purpose, since Xgj/g = o(l) for some admissible choices 
of ( fT2] i (when written as an equality of polynomials) 

can be expressed as 

A. . , .„,., , . /?(i + o(l)) 

• (It \ A • ' 



^ (0,0) 



B^] > 0}. Using 



where 5*^ 

latter equation can be written in the form 

At 



this 



^ jBI']cHxo{I3!X)^) =1 + 0(1) 



(83) 



'Here (and often throughout the proof) we use the property (l + o(l))'' 
1 + o(l) for rational k. 
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where Tij ~ > 0. It follows that, as /3 — > 0, the left- Consider now the term jj J2tei^ log(A^*H^o))- Because of 

hand side of ( l83l ) is dominated by summands corresponding dsTl i. we have 

to admissible choices of for which xqP'^^-^^'^ tends to „ „^ 

a constant. Letting T = min{rij : t e ly and e A'^*\zq) = ( 1 + -^(1 + o(l)) if n ^ r 

S^}, these dominating summands necessarily correspond to I 1 + '^(P) if rt > r 

admissible choices of (z, j') such that T,, = T. In fact, assume ^ ^^^^^^ j ^ ^^^^^ ^ ^ ^ 

that = c + o(l) for some r,,j > T and constant 

c. Then, for all choices of (i, j) such that Tij = T, the term ^ ^(*)f / ^-^{^ + o(l)) if rt ~ r 
xt^P'^'-i/'^ would be unbounded, contradicting (l83T l. Hence, we ^ o(^) if n > r . 

have 



y j<)c^>fxo(/3/A)^)' = 1 + 0(1), 



I.e.. 



Qi (xo(e/3f/''') =l + o(l) 



This yields 

J tele. t : rt=r 

and finally, recalling ( [TtI i. 



and therefordl TI E 7* log(^^*^ (-o)) = ^ d + o{l)) . (87) 



^i(i)^-T/v.(;L^p(^)) _ (84) We then have 



r 

ei 



_T/4, 

Next, we develop an expression for /3 in terms of a. Similarly E] -'^°g(^^*''('^o)) H — — = + '^(1)) • 

to (fT2b . ( fTTI ) (when written as an equality of polynomials) can te/c 

be expressed as (88) 

.^-^ Af ■r-^ (J) Next, the term — alogi-Q may be developed as follows, 

E -TJx E * ^0% = "(1 + o(l)) 

-alogxo = -alog ( -^5^^/? ' ' {1 + o{l)) j 



where now o(l) is intended as a — )- 0. Using (|82] | and dividing 

each side by /? we obtain (b) _ , / tonrorVn^^^/"^ .v^^/'^ 



E^ E ^B^^jc^f^U{PIx{-^) =^(l + o(l)). i 



—a 



ioggr\i)+^iogg2(Qr'(i))-Tiog"-T+''(i^ 



Reasoning in the same way as we did for m, we can write ^^ere we have used dH in (a), m in (b), and the Taylor 
the previous equation in the fom ^^^^s l°g(l + ^) ^ = ^ (c)' He"'^^' conclude 



that 



Q2 (xo(e/3)^/'^) =^(1 + 0(1)) 
which, using ( l84l i. become^ 



IT 1 

a log a;o = a ( log — + — log 



?r'(i) V' ''Q2(Qr'(i))- 

+ ^aloga+^Q2(Qr'(l))/5 + o(a) (89) 

Q2(Qr'(i))- ^(1 + 0(1))- ^ ^ 

where we have again used (|85T l. 
This yields Finally, we analyze the term J2tei (^O' Vo)- Us- 



/5= 7777^^T7TTt(1 + «(!))■ (85) 



ing ( [82] i and ( [84l l. we obtain 



We conclude from (|85] | that /3 is proportional to a to the first (ij)g5- 
order, so that o{f3) and 0(0;) are equivalent notations. / 0^^(1)\^ 

We next use the derived expressions to analyze (|9]l. Using = 1+ E -S,- *] f T/ip ) (/^)^ /J'^"^ (l+o(l)) . 
the Taylor series of log(l + x) around a; = 0, we have j)eS^ 

log(l-/?/A) ^ ^ ^^^y^ ^gg^ From T,,, = l-± > T for all t e /„, (ij) e it follows 

that > 1 for all t e /„, G 5*4", with equaUty if and 
only if t e y„ and £ Pt- Then we have 

*Note that, using the Taylor series of Qi^{l + x) around 2: = 0, we have 
Q^\l + o{l)) = Q^\l) + o{l). (t)fQVHl) 



We that Q2(Qr'_(i)(i + °(i))) = Q2(Qr'(i)) + "«i"g B'-*\xo,yo) ^1+ E ( ^ttV^ ) (i'^)'' 

Taylor series of Q2{Qi ^(1) + '->:) around a: = 0. Pt 
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when t £ Yy, and B*^*^ (.tq, 2/0) = 1 + o(/3) otherwise. This 
imphes that 



logi?(*)(xo,yo)= E 



(/A)^/3(l+o(l)) 
(90) 

when t S Yv, and logB^*-* (xo, yo) = o(/3) otherwise. This 
yields 



E,5ilogi?(*)(xo,yo) 



te/„ 



(a) 



(/A)' 



- /3(l + o(l))E5, E 4; 

ten (ij)6-Pt 



ten (jj)ePt 

/3(i + o(i))^, ^ ^Qr'(i) 



ten (ij)e-Pt 



-/3^(i+o(i))E^t E ^^ni^) 

(c) /3(1 + 0(1)) ^ At 



. E ^ E ^^S^^ (or^(i))^ 

ten ^* (»j)ePt ^ ^ 



where we have used ( |9Q] l in (a), and i/j = j — iT for t e Yj, 
and G Pt in (b) and in (c). Hence, recalling (fTsT i and 

(fT6T i. we obtain 

E St log (xo , yo) = ^il±^ (1 - T (gr^ (1))) . 



te/„ 



Finally, substituting 
(fl4] i. as desired. 



(91) 

, and (I9TI ) into (|9|l, we obtain 



Appendix C 

Closed Form Expressions for the Spectral Shape 

It is worthwhile to note that in some cases, ( |38] | can be 
expressed in closed form because f^^(a) can be expressed 
analytically. This is the case, for instance, for the (3, 6) regular 
LDPC ensemble, for which f (z) = a becomes ax^+bx'^+cx+ 
d = 0, where x ~ z'^ and (a, b, c, d) = (a— 1, 15a— 10, 15a — 
5, a). This cubic equation in x may be solved by Cardano's 
method (see, e.g., Il26l p. 17]; the discriminant A = p'^ + 
is negative for every a € (0, 1), where 

Sac - 9abc - 21a^d - 2b^ 



P 



9a2 ' ^ 54a3 
The required solution is then uniquely and analytically iden- 
tified as that given by dSSl l where g = 3, s = 6 and 
f-^a) = z = y/^ where a; = 2V^cos(e'/3) - 3^ > 
and e = tan^i (y/^/^). 

Similarly, the weight spectral shape of a (4, 8) regular 
LDPC ensemble may be expressed in closed form through 
the solution of a quartic equation. 
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